MINIMAL PERIOD ESTIMATES FOR BRAKE ORBITS OF 
NONLINEAR SYMMETRIC HAMILTONIAN SYSTEMS 
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Abstract. In this paper, we consider the minimal period estimates for brake orbits 
of nonlinear symmetric Hamiltonian systems. We prove that if the Hamiltonian 



' function H G C'^(M'^",R) is super-quadratic and convex, for every number t > 0, 

, there exists at least one r-periodic brake orbit (r, a;) with minimal period t or t/2 

+^ ■ provided H{Nx) = H{x). 



^1 Introduction and main result 

> , 

CSl '. Let J = and = ^ with / being the identity of M"^. Suppose 

p ; He C2(M2n^ satisfying 

od 

H{Nx)=H{x), VxgM^". (1.1) 

O 



We consider the following problem 

x{t) = JH'{x{t)), 

x{-t)=Nx{t), (1.2) 
x{T + t) = x{t), Vt G M. 

A solution (r, x) of (1.2) is a special periodic solution of the Hamiltonian system 
in (1.2), we call it a brake orbit and r the brake period of x. 

The existence and multiplicity of brake orbits on a given energy hypersurface 
was studied by many Mathematicians. In 1987, P. Rabinowitz in [26] proved that if 
H satisfies (1.1), S = H~^{1) is star-shaped, and x ■ H'{x) ^ for all x G E, then 
there exists a brake orbit on E. In 1987, V. Benci and F. Giannoni gave a different 
proof of the existence of one brake orbit on E in [1]. In 1989, A. Szulkin in [27] 
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proved that there exist at least n brake orbits onT,,ii H satisfies conditions in [26] 
of Rabinowitz and the energy hypersurface S is v^-pinched. Long, Zhang and Zhu 
in [23] proved that there exist at least 2 geometrically distinct brake orbits on any 
central symmetric strictly convex hypersuface E. Recently, Z.Zhang and the author 
of this paper in [16] proved that there exist at least [n/2] + 1 geometrically distinct 
brake orbits on any central symmetric strictly convex hypersurface E, furthermore, 
there exist at least n geometrically distinct brake orbits on E if all brake orbits on 
E are non-degenerate. 

In his pioneering work [24], P. Rabinowitz proposed a conjecture on whether a 
superquadratic Hamiltonian system possesses a periodic solution with a prescribed 
minimal period. This conjecture has been deeply studied by many mathematicians. 
For the strictly convex case, i.e., H"{x) > 0, Ekeland and Hofer in [6] proved that 
Rabinowtz's conjecture is true. We refer to [3]-[6],[8], [10], [17]-[19], and reference 
therein for further survey of the study on this problem. 

For Rabinowitz' conjecture on the second order Hamiltonian systems, similar 
results under various convexity conditions have been proved (cf. [5] and reference 
therein). In [17] and [19], under precisely the conditions of Rabinowitz, Y. Long 
proved that for any r > the second order system 

x + V'{x) = 

possesses a r-periodic solution x whose minimal period is at least r/ (n + l). Similar 
result for the first order system (1.1) is still unknown so far. 

It is natural to ask the Rabinowitz 's question for the brake orbit problem: for 
a superquadratic Hamiltonian function H satisfying condition (1.1), whether the 
problem (1.2) possesses a solution (r, x) with prescribed minimal period r for any 
T > (brake orbit minimal periodic problem in short). 

In this paper we first consider the brake orbit minimal periodic problem for the 
nonlinear Hamiltonian systems. From Section 3, we have the following result. 

Theorem 1.1. Suppose the Hamiltonian function H satisfies the conditions: 
(HI) H e C2(R2n^^) satisfying H{Nx) = H{x), Va; e R^". 
(H2) there are constants /i > 2 and ro > such that 

< iiH{x) < H'{x) ■ X, y\x\ > ro. 

(H3) H{x) = o{\x\'^) near a; = 0. 

(H4) H{x) > 0, Vx G 

(H5)H"{x)>0, VsgR^'^. 
Then there exists a brake orbit {t,x) of problem (1.2) with minimal brake period r 
or t/2. 

In fact, in Section 3 a more general theorem is proved (see Theorem 3.1) where 
the superquadratic condition {H2) is relaxed to 

H{x) = hBx,x) + H{x) 

with H satisfying condition (iy2), and the convexity condition (H5) is relaxed to 

H"{x{t)) > 0, Vt e R and J^^'^ H"{x{t)) dt > for aU brake orbit (r, x). 
We also prove some results about the brake orbit minimal periodic problems for 
the second order Hamiltonian systems in Section 3. 
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§2 Iteration inequalities of the Lq-index theory 

We observe that the problem (1.2) can be transformed to the foUowing La- 
grangian boundary value problem 

x{t) = JH'ixit)), 
x{0) e Lo, x{t/2) eLo, 

where Lq = {0} x R'^ c M2n_ 

An index theory suitable for the study of problem (2.1) was established in [13] 
for any Lagrangian subspace L. As usual, we denote 

Sp(2n) = {M e £(M2")| M^JM = J}, 



r{2n) = {7 e C{[0, 1], Sp(2n))| 7(0) = hn} 

and 

Vr{2n) = {7 G C([0, r], Sp(2n))| 7(0) = hn}- 

For a symplectic path 7 G V{2n), its Maslov-type index associated with a La- 
grangian subspace L is assigned to a pair of integers (iL(7), '^l(7)) £ Zx {0, 1, • • • , n}. 
We call it the L-index of 7 in short. In [23], the index /Xj(7), j — 1,2 was defined 
for 7 e V{2n), the //^-indices are essentially the special L-indices for L = Lq and 
L = Li = X {0} C M^"' up to a constant n, respectively. In order to estimate 
the period of a brake orbit, we need to estimate the Lo-index of the iteration path 
7^ associated to the iterated brake orbit x''. 

For reader's convenience, we recall the definition of the Lo-index which was first 
established in [13]. Some properties for this index theory are listed in the appendix 
below. For Lq = {0} ® M*^, we define the following two subspaces of Sp(2n) by 

Sp(2n)i^ = {M G Sp(2n)| det F ^ 0}, 
Sp{2n)l^ = {M G Sp(2n)| detV ^ 0}, 

fo.M=(^ I). 

Since the space Sp(2n) is path connected, and the nxn non-degenerated matrix 
space has two path connected components, one with det V > 0, and another with 
det y < 0, the space Sp(2n)^p has two path connected components as well. We 
denote by 

Sp(2n) = {M e Sp(2?i) I ± det y > 0} 

then we have Sp(2n)^^ = Sp(2n)J^ U Sp(2n)^^. We denote the corresponding 
symplectic path space by 

^(2n)l3 = {7 e ^(2n)| 7(1) e Sp{2n)lJ 

and 

rC^nf^^ = {7 e ri2n)\ 7(1) G Sp(2n)0 J. 
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Definition 2.1. We define the Lo-nullity of any symplectic path 7 e V{2n) by 

VLoil) = diiiiker/,Q(7(l)) := dimker — n — rankV(l) 

with the n X n matrix function V{t) defined in (2.1). 

We note that rank = '"'5 so the complex matrix U{t) ± ^/^V{t) is 

invertible. We define a complex matrix function by 

Q{t) = [U{t) - V^VmU{t) + ^V{t)]-\ 

It is easy to see that the matrix Q{t) is a unitary matrix for any t e [0,1]. We 
denote by 

M+=(_°^ f), ^ = <iiag(-l,l,...,l). 

It is clear that M± e Sp(2n) J^. 

For a path 7 G P(2n)^^, we first adjoin it with a simple symplectic path starting 
from J = — M_|_, i.e., we define a symplectic path by 



lit)- 



/cos^i^|^ + Jsin^i^, [0,1/2]; 
7(2t-l), [1/2,1]. 



then we choose a symplectic path in Sp(2n)^^ starting from 7(1) and ending 
at M+ or M_ according to 7(1) G Sp(2n)J^ or 7(1) G Sp(2n)^^, respectively. We 
now define a joint path by 

-u) = g ~ ^ f 7(2t), [0,1/2], 
^*^- l/3(2t-l), tG [1/2,1]. 

By the definition, we see that the symplectic path 7 starting from — and ending 
at either M4. or M_. As above, we define 



Q{t) = mt) - v^vmm + v^m] 



-1 



for 7(t) = ^^l^j ^l^j ^ ■ choose a continuous function A{t) in [0, 1] such 

that 

detQ(t) = e2^^W. 

By the above arguments, we see that the number ^{A{1) — A(0)) G Z and it does 
not depend on the choice of the function A(t). We note that there is a positive 
continuous function p : [0, 1] — > (0, +00) such that 

det{U{t) - ^/^V{t)) = p{t)e^^^'l 
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Definition 2.2. For a symplectic path 7 e V{2n)^^, we define the Lg-index of 
by 

z^„(7) = i(A(l)-A(0)). (2.2) 



TT 



For a Lo-degenerate symplectic path 7 e V{2n)']^^, its Lo-index is defined by the 
infimum of the indices of the nearby nondegenerate symplectic paths. 

Definition 2.3. For a symplectic path 7 e V{2n)']^^, we define the Lo-index of ■y 
by 

iLo{l)= sup ■MLM\l^UnV{2n)lJ, 

UeATiy) U 

where N'{'y) is the set of all open neighborhood of ^ in V{2n)Lo- 

Suppose the continuous symplectic path 7 : [0, 1] —>■ Sp(2n) is the fundamental 
solution of the following linear Hamiltonian system 



z{t) = JB{t)z{t) 



(2.3) 



with B{t) satisfying B{t + 2) = B{t) and B{1 + t)N = NB{1 - t)). We define the 
Lo-iteration paths 7^ : [0, k] — > Sp(2n) of 7 by 

7'(t) = 7(*), ie[0,l], 



l\t) 



and in general, for j G N 



lit), [0,1] 

Ar7(2-t)7(l)-iAr7(l), te[l,2]. 



lit), [0,1], 

Ar7(2-t)7(l)-iiV7(l), te[l,2]. 



(2.4) 



Nj{2j - 2 - ^)7(l)-liV7(l)7(2)2^-^ t G [2j - 3, 2j - 2], 
7(t - 2j + 2)7(2)2J-^ t e [2j - 2, 2j - 1], 



i^'it) = <; 



lit), t e [0,1], 

iV7(2-t)7(l)-iiV7(l), te[l,2], 



(2.5) 



7(t - 2j + 2)7(2)2^-4, t e [2j ~ 2, 2j - 1], 
iV7(2j-t)7(l)-iiV7(l)7(2)2^-3, t e [2j-l,2j], 



We note that if 7(^)5 t G R is the fundamental solution of the linear system (2.3), 
then there holds 7^^ = 7|[o,fc]- For the iteration path 7^^, the following Bott-type 
iteration formulas were proved in [16]. 
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Proposition 2.4. Suppose ojk = e^^^l^ . For odd k we have 

[k/2] 

i=l 

[k/2\ 



"k 



for even k, we have 



fc/2-l 

^Lo(7')=^Lo(7')+^5/.(7')+ E 



fc/2-1 

^L^l') = ^L^l') + ^;.°/.(7^) + E ^.-(7'), 

1=1 

where the (Lq-lo) index (^(^"(7), i^i;'°(7)) 0/7 /or a; e U := e C| \z\ — 1} w;as 
defined in [16], and the co-index (^u^(7^), ^'a'(7^)) 0/7^ for u e U w;as defined in 
[22](cf.[21]). 

k /2 / 

We note that = v— 1. For any two 2ki x matrices of square block form, 
Mi — ^ j with i = 1,2, the o-product of Mi and M2 is defined to be the 



2(A;i + A;2) x 2(/ci + k2) matrix 



Ml o M2 = 



fAi Si 

^2 52 

Ci Di 

V C2 D2. 



Denote by M*'^ the /c-fold o-product of M. Let Ni{\h) = ^ ^ for A = ±1 and 

h — ±1, or 0. Denote by R{6) = ( ^'^^^ ^^^^ ] . We remind that the unit circle 
' ^ \sm6 cos9 J 

in the complex plane is defined hj U = {z E C : 1^1 = 1}, and the upper (lower) semi 

closed unit circle U+(U~) is defined by = G U : 2: = e^^^, < ±6' < tt}. 

In [22], for any M e Sp(2n), Long defined the homotopy set of M in Sp(2n) by 

n{M) = {N e Sp(2n) I (j{N) n U = (j{M) n U and 

dime kerc(iV - XI) = dime kere(M - A/), VA e a{M) n U}. 

The path connected component of Q(M) which contains M is denoted by f2o(M), 
and is called the homotopy component of M in Sp(2n). 

In [15], the following result was proved (cf. Theorem 10.1.1 of [21]). 
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Proposition 2.5. 1° For any 7 e V{2n) and a; e U \ {1}, there always holds 



kil) + I'li^) - n < (7) < ii (7) + n - ly^j (7) • (2-6) 

2° The left equality in (2.6) holds for some u) G U"'' \ {1} (or U~ \ {1}) if and 

only if there holds l2p o — l)*"^ o K E Oo(7(r)) for some non-negative integers 

p and q satisfying < p + q < n and K G Sp(2(n — p — q)) with ^{K) C U \ {1} 
satisfying that all eigenvalues of K located within the arc between 1 and u including 
uj in U"*" (or possess total multiplicity n — p — q. If u) ^ —1, all eigenvalues 
of K are m U \ M and those in U"'" \ R (^or U~ \ are all Krein negative (or 
positive) definite. If u = —1, it holds that — o A^i( — 1, 1)** o if G Oo(-^) for 
some non-negative integers s and t satisfying < s -\- 1 < n — p — q, and some 
H G Sp(2(n — p — q — s — t)) satisfying o'{H) C U \ M and that all elements in 
(7{H) n U"'" (or (t{H) n are all Krein-negative (or Krein-positive) definite. 

3° The left equality in (2.6) holds for all u G U \ {1} if and only if l2p o 
A^i(l, — 1)**^"""^^ G ^0(^(7)) for some integer p G [0,n]. Specifically in this case, 
all the eigenvalues of ^{t) equal to 1 and T^ril) = n + p > n. 

4° The right equality in (2.6) holds for some u) G U"*" \ {1} (or U~ \ {1}^ if 
and only only if there holds l2p o -^1(1, 1)*^ o K E Qo{'^{t)) for some non-negative 
integers p and r satisfying < p -\- r < n and K G Sp(2(n — p — r)) with o'{K) C 
U \ {1} satisfying the condition that all eigenvalues of K located within the closed 
arc between 1 and u in U"'" \ {1} (or U~ \ {Ijj possess total multiplicity n — p — r. 
If LO ^ —1, all eigenvalues in (7[K) fl U"*" (or cr^K) n \J~ ) are all Krein positive 
(or negative) definite; if u) = —1, there holds {—l2s)oNi{—^,^y*oH G Qo{K) 
for some non-negative integers s and t satisfying 0<s-\-t<n — p — r, and some 
H G Sp(2(n — p — r — s — t)) satisfying c^H) C U \ R and that all elements in 
cr(if) n U"'" (or (j{II) fl U~j are all Krein positive (or negative) definite. 

5° The right equality in (2.6) holds for all u G U \ {1} if and only if l2p o 
A''i(l, 1)**^""^) G VLq{'~^{t)) for some integer p G [0,n]. Specifically in this case, all 
the eigenvalues of ^{r) must he 1, and there holds i^ril) = n -\- p > n. 

6° Both equalities in (2.6) hold for all uj &XJ if and only if j{t) = l2n- 

Combining Propositions 2.4 and 2.5, we have the following result. 
Theorem 2.6. 1° For any 7 G V{2n) and A; G N, there holds 



(n(7') + ^i(7')-n)<ZLo(7') 



(ii(7) + n)-^i/i(7'') + ^^^i(7'), i/A;G2N-l, (2.7) 



^Lo(7')+ 

<*Lo(7') + 

(7^) + ^^(7^) + - 1) (h (7') + ^1 (7') -n)< iL, (7') < iL, (7^) + 
+ (I - 1) (h(7) + n) - ^1.1(7''=) + ^^1(7') + ifk G 2N. (2.8) 

The index (^(^;"(7), ^'i;'°(7)) is defined in [16] for uj G U = {2 G C| \z\ = 1}, see also 
Definition 4-9 in the appendix below. 
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2° The left equality of (2.7) holds for some k > 3 and of (2.8) holds for some 
k > 4 if and only if there holds o -/Vi(l, — 1)*'^ o K E Oo(7^(2)) for some non- 
negative integers p and q satisfying p + q < n and some K G Sp(2(?i — p — q)) 
satisfying a {K) C U\M. If r ^n-p-q > 0, then R{9i) o ■ ■ ■ o R{9r) e QqIk) for 
some 9j G (0,7r). In this case, all eigenvalues of K on U"*" (on U~ ) are located on 
the arc between 1 and exp(27r-\/^/A;) (and exp{—27ry/^/k)) in U'^ (in 'U~ ) and 
are all Krein negative (positive) definite. 

3° The right equality of (2.7) holds for some k > 3 and of (2.8) holds for some 
k > 4: if and only if there holds l2p o 1)*'^ G ^0(7^(2)) for some non-negative 

integers p and r satisfying p-\- r = n. 

4° Both equalities of (2.7), and also of (2.8), hold for some k > 2 if and only if 

7^(2) = hn. 

Proof. By Proposition 2.4, summing the inequalities of (2.6) with u) = 1 < i < 
k/2,i G N, we obtain the inequahties (2.7) for odd k and (2.8) for even k. We 
remind that here we have used the Bott-type formula 

The equality conditions follow from 2° and 4° of Proposition 2.5 together with 
Corollary 9.2.8 and List 12 in P198 of [21]. We note that from List 12 in P198 of 
[21], no eigenvalue on U"*" is Krein positive definite. 

Since we should consider the Bott-type iteration formulas in Proposition 2.4 in 
odd and even cases, the inequalities in Theorem 2.6 is naturally considered in two 
cases correspondingly. We will see that the inequalities in Theorem 2.6 for even 
times iteration path are our main difficult to prove that the brake orbit found in 
Section 3 has minimal period, though we believe this kind brake orbit has minimal 
period, we can only prove that it has minimal period or it is 2-times iteration of a 
brake orbit with minimal period. 

§3 Applications to nonlinear Hamiltonian systems 

We now apply Theorem 2.6 to the brake orbit problem of autonomous Hamil- 
tonian system 

-Jx = Bx-\- H'{x), xgR^", 

x(T/2-\-t) = Nx(T/2-t), (3.1) 
x{T-{-t) = x{t), t G R, 

where II{Nx) = II{x) and B = ^ ^ is a 2n x 2n symmetric semi-positive 

definite matrix whose operator norm is denoted by Bi and B2 are n x n 

symmetric matrices. A solution (r, x) of the problem (3.1) is a brake orbit of the 
Hamiltonian system, and r is the brake period of x. To find a brake orbit of the 
Hamiltonian system in (3.1), it is sufficient to solve the following problem 

-Jx{t) = Bx + H'ixit)), xeR^^,te[0,T/2], 
x{0) G Lo, x{t/2) G Lo. 



Any solution x of problem (3.2) can be extended to a brake orbit (r, x) with the 
mirror symmetry of Lq by x{t/2 + t) = Nx{t/2 — t), t E [0, t/2] and x{t + t) = 

x{t), t e M. 

Theorem 3.1. Suppose the Hamiltonian function H satisfies the conditions: 
(HI) H e C^(M?'',R) satisfying H{Nx) = H{x), Vx G M^^. 
(H2) there are constants /x > 2 and tq > such that 

< nH{x) < H'{x) ■ X, \/\x\ > ro. 

(H3) H{x) =o{\x\^) atx = 0. 

(H4) H{x)>0 Vx e ]R2n_ 
Then for every < r < -jj^, the system (3.1) possesses a non-constant brake orbit 
(r, x) satisfying 

tLo{x,T/2)<l. (3.3) 

Moreover, if x further satisfies the following condition: 

(HX) H"{x{t)) >0 yteRand J^^^ H" {x{t)) dt > 0. 
Then the minimal brake period of x is r or t/2. 

We remind that if S = 0, then = +oo. 
Proof. We divide the proof into two steps. 

Step 1. Show that there exists a brake orbit {t,x) satisfying (3.3) for < r < jj^. 

Fix T G (0, |j^). Without loss generality, we suppose r = 2, then r < 
implies ||i?|| < n. By conditions (H1)-(H4), we can find a non-constant r-periodic 
solution X of (3.2) via the saddle point theorem such that (3.3) holds. For reader's 
convenience, we sketch the proof here and refer the reader to Theorem 3.5 of [15] 
for the case of periodic solution. We note that the main ideas here are the same as 
that in the periodic case. We refer the paper [11] for some details. 

In fact, following P. Rabinowitz' pioneering work [24], let K > and x ^ 
C°°(M,M) such that x{t) ^ 1 ilt < xif) = if t > X + 1, and x'iS) < if 
y e (K, K The number K will be determined later. Set 

Hk{z) = \{Bz,z)^Hk{z), 

with 

Hk{z) = x{\z\)H{z) + (1 - x{\z\))Rk\z\\ 
where the constant Rk satisfies 

H{z) 

Rk > max , . . . 

K<\z\<K+l \z\^ 

We set L2 = L2([0, 1], M^n) ^nd define a Hilbert space E := Wl^ = W^lf '^([0, 1], M^^) 
with Lq boundary conditions by 

= {ze z{t) = ^exp(A;7rtJ)afe, e Lq, ||2;|p := ^(1 + \k\)\ak\'^ < oo}. 

kez kei. 
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We denote its inner product by (•,•). By the well-known Sobolev embedding theo- 
rem, for any s e [1, +00), there is a constant Cg > such that 

Define a functional fx on E by 

1 

Mz) = {-z ■ Jz - Hk{z)) dt, yz e E. (3.4) 
For m e N, define E^ = Lq, 

m 

Em^ {z e E \ z{t) = ^ ex.p{k7rtJ)ak, G Lq}, 

k=—m 

E^ = {z e E \ z{t) = ^ exp{k7rtJ)ak, ak G Lq}, 

±fc>o 

and E+=Emn E+ , E-=EmnE-. We have Em = E'OE^® E+. Let Pm be 
the projection Pm '■ E — > E^,- Then {Em, Pm}men form a Galerkin approximation 
scheme of the operator —Jd/dt on E. Denote by fK,m = /atIs^- Set Qm = 
{re : < r < n} © {S,.,(0) H (£;" © £;^)} with some e G aSi(O) n E+. Then 
for large ri > and small p > 0, 9(5m and -Bp(O) fl E'^ form a topological (in 
fact homologically) link (cf. P84 of [2]). By the condition < tt, we obtain a 
constant (3 = (5{K) > such that 

(I) fK,m{z)>i3>Q, yzedBp{o)nE+, 

(II) fK,mi^) < 0, yze dQm. 

In fact, by (H3), for any e > 0, there is a 5 > such that Hx{z) < s\z\'^ if \z\ < 5 . 
Since Hk{z)\z\~'^ is uniformly bounded as 1^1 —>■ +00, there is an Mi = Mi{K) such 
that Hk{z) < Mil^l^ for \z\ > 5. Hence 

^k(-z) < ekP + Mil^l^, V^gR^^. 

For z G aSp(O) n E+, we have 



1 

2 I )\/r II„I|4 ^ /„/o2 I 71 ^- II _ii2mi _||2 



/" iyK(t,^)dt < £||^||^2 + Ml 11^11^4 < (eC^ + MiC|||^||^)||^ 



So we have 

/K,m(-2) = 1{AZ,Z) - \{BZ,Z) - ^ HK{z{t))dt 



> Iw^r - ^ii^ii' - (eci + M,ci\\zr)\\zr 
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Since ||5|| < tt, we can choose constants p = p{K) > and p = 0{K) > 0, which 
are sufficiently small and independent of m, such that for z e dBp{0) n E^, 

fK,m{^) >/3>0. 

Hence (I) holds. 

Let ee E+n dBi and z = 2;" + 2;^ e -E" © E^ . We have 

1 11 /"^ - 

fK,m{z + re) = -{Az-,z-) + -r'^{Ae,e) - -{B{z + re), z + re) - J HK{z + re)dt 



TT,, _,,2 , TT 2 



<-^\\z~\\+^r'-l HK{z + re)dt, 



1 







If r = 0, from condition (H4), there holds 



If r = ri or ||2;|| = ri, then from (H2), We have 

HK{z)>bi\z\^ -b2, 

where bi > 0, 62 are two constants independent of K and m. Then there holds 

HK{z + re)dt>bi f \z + re\^dt-b2 
Jo 



1 . 

1 \ 2 



|2; + re|^(itJ —64 
>65(lk°r + r'^) -&4, 
where 63, 64 are constants and 65 > independent of K and m. Thus there holds 

+ re) < ~\\z- 1|2 + - 65 + r^) + 

So we can choose large enough ri independent of K and m such that 

¥'m(^ + ''e) < 0, ondQm- 

Then (II) holds. 

Now define J] = e C{Qm, Em) \ ^{x) = x forxe dQm}, and set 

CK,m = inf sup fK,m{x). 

It is well known that satisfies the usual (P.S)* condition on E, i.e. a se- 
quence {xm} with Xm £ Em posscsscs a convergent subsequence in E, provided 
fkmi^m) — >^ as m — > 00 and \fK,m{xm)\ < b for some 6 > and all m G N 
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(see [11] for a proof). Thus by the saddle point theorem (cf. [25]), we see that 
CK,m > /? > is a critical value of //c,m7 we denote the corresponding critical point 
by 

^K,m- The Morse index of xx.m satisfies 

'^~{xK,m) < dimQ^ = mn + n + 1. 

By taking m +oo, we obtain a critical point xk such that XK,m — ^ xk, w — ^ +oo 
and m^{xK) < dimQ^ = 1 + n + mn, < ck = Jk^xk) < Afi, where the d-Morse 
index {^k) is defined to the total number of the eigenvalues of f'J^ belonging to 
(— oo, d] for d > small enough, and Mi is a constant independent of K. Moreover, 
by the Galerkin approximation method. Theorem 2.1 of [14], we have the d-Morse 
index satisfying 

TTT'di^K) = "^n + n + iLoi^K, 1) < 1 + n + mn. 

Thus we have 

iLoi^K, 1) < 1- 

Now the similar arguments as in the section 6 of [25] yields a constant M2 in- 
dependent of K such that ||xk||oo < M2. Choose K > M2. Then x = xk is 
a non-constant solution of the problem (3.2) satisfying (3.3). By extending the 
domain with mirror symmetry of Lq, we obtain a 2-periodic brake orbit {2,x) of 
problem (3.1). 

Step 2. Estimate the brake period of (2, x). 

Denote the minimal period of the brake orbit x by 2/k for some A; G N, i.e., 
{x,l/k) is a solution of the problem (3.2). By the condition (HX) and B being 

semi-positive definite, using (9.17) of [4], we have that ii{x, 2/k) > n for every 2/k- 
periodic solution {x,2/k) (see also (4.2) in the appendix below), and by Theorem 
5.2 of [13] we see that ^L;, (x, l//c) > for the Lo-solution (x, l/k) (see also (4.3) in 
the appendix below). Together with (3.21) of [16] (see also (4.14) in the appendix 
below), we obtain 

i^{x,l/k) >iLo{x,l/k)>0, ii{x,2/k)>n. (3.5) 

Since the system (3.1) is autonomous, we have 

vi{x,2/k)>l. (3.6) 

Therefore, by Theorem 2.6, (3.3) and (3.5)-(3.6), we obtain k = 1,2,3,4. 

If A; = 3, by (3.3) and (3.5)-(3.6), and by using Theorem 2.6 again we find 
the left equality of (2.7) holds for A; = 3 and z_Lo(a;, 1/3) = 0, zi(a;,2/3) = n, and 

1^1 (x, 2/3) = 1. 

The left side hand equality in the inequality (2.7) holds if and only if l2p o 
Ni{l, —ly'^ o K e 00(7(2/3)) for some non-negative integers p and q satisfying 
p + q < n and some K e Sp(2(n — p — q)) satisfying a{K) C U \ R. If r = 
n — p — q > then by List 12 in P198 of [21] (see also the list after Definition 4.4 
in the appendix below), we have R{9i) o ■ ■ ■ o R{9r) G Qo{K) for some 9j G (0, tt). 
In this case, all eigenvalues of K on U"*" (on U~) are located on the arc between 
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1 and exp(27r-\/^//c) (and exp(— 27r-\/^/A;)) on U+ (in U~) and are all Krein 
negative (positive) definite. We remind that 7(t) is the fundamental solution of the 
linearized system at (2/3, x). By the condition Ui{x, 2/3) = 1, we have p = 0, q ~ 1. 
By Lemma 4.3 in the appendix below, there are paths a G 7^2/3(2), /3 G P2/3(2n — 2) 
such that 7 ~ Q!0/3, q;(2/3) = A''i(l, —1), /3{t) = K. By the locations of the end 
point matrix q;(2/3) and /3(2/3), there are two integers fci, /c2 such that (see the 
proof of Theorem 4.3 in [15], specially (4.18) and (4.19) there). 

zi(a,2/3) = 2fci, ii(/3,2/3) = 2^2 + n- 1. 

From this result, we see that if n = 1, then A''i(l, —1) G Oo(7(2/3)), and zi(a;,2/3) 
must be even, so ii(x, 2/3) = n = 1 is impossible. If n > 1, we have n — 1 > and 

zi(a;,2/3) = 2(/ci + /C2) + n - 1. 

But ii{x, 2/3) = n, so A;i + A;2 = ^. It is also impossible. 

If /c = 4, the solution (1/2, x) itself is a brake orbit. Thus ii(x, 1/2) and ii(a;, 1) 
are well defined and by Theorem 2.6, we have that the left hand side equality in 
(2.8) holds for /c = 4 and 

h{x, 1/2) = n, vi{x, 1/2) = l,iL,{x, 1/4) = ^^(a;, 1/4) = 0. 

By the same arguments as above, we still get ii{x, 1/2) = 2{ki + + n — 1. This 
is also impossible. ■ 

Remark 3.2. If S = 0, the results of Theorem 3.1 hold for every r > 0. The 
following condition is more accessible than (HX) but it implies the condition (HX). 
(H6) H"{x) > for aU x G R^", the set D = {x e m?''\H'{x) 0, G a{H"{x))} 
is hereditarily disconnected, i.e. every connected component of D contains only 
one point. 

Similarly, we consider the brake orbit minimal periodic problem for the following 
autonomous second order Hamiltonian system 

x + V'{x) = Q, xgM", 

a;(0) = x{t/2) = (3.7) 
x{T/2 + t) = -x{T/2-t), x{T + t) =x{t). 

A solution {t,x) of (3.7) is a kind of brake orbit for the second order Hamiltonian 
system. 

In this paper, we consider the following conditions on V: 
(VI) FgC2(M",R). 

(V2) There exist constants /x > 2 and ro > such that 

< iiV{x) <V'{x) ■ X, V|a;|>ro. 

(V3) V(x) > V{0) = Va; G R". 

(V4) V{x) = o(|xp), at X = 0. 
(V5) V{-x) = V{x), G E". 
(V6) V"{x) > 0, Vx G M. 
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Theorem 3.3. Suppose V satisfies the conditions (V1)-(V6). Then for every r > 
0, the problem (3.7) possesses a non-constant solution {t,x) such that the minimal 
period of x is t or t/2. 

Proof. Without loss generality, we suppose r = 2. We define a Hilbert space W 
which is a subspace of VF^'^([0, 1], M") by 

oo 

W = {xe W^'^{[0,l],R'^)\x{t) = ^sin/cTTt-afe, ak G E'^}. 

k=l 

The inner product of W is still the W^'^ inner product. 
We consider the following functional 

1 

i(;{x)^ / {-\x\'^ -V{x))dt, VxeW. (3.8) 
Jo 2 

A critical point a; of V' is a solution of the problem (3.7) by extending the domain to 
M viaa;(l+t) ^ -x{l-t) and x{2 + t) = x{t). The condition (V3) implies -(/'(O) = 0. 
The condition (V4) implies ip{dBp{0)) > ao with dBp{0) — {x e W\\\x\\ — p} for 
some small p > and ckq > 0. In fact, there exists a constant ci > such that 

1 

(it > ci ||a;||^. (3-9) 

If \\x\\w — ^ 0, then ||a;||oo — 0. So by condition (V4), for any < £ < ^, there 
exists small p > such that 

1 

V{x{t))dt < s\\x\\2 < £||a;||^, \\x\\w = P- 
Thus we have 

1-1 

^(x) = {^\xf - V{x)) dt>{^- e)p' := ao > 0. 

The condition (V2) implies that there exists an element xq G with ||xo|| > p, 
such that iI){xq) < 0. In fact, we take an element e E W with ||e|| = 1 and by (V3) 
we assume V{e{t))dt > 0. Consider x = Ae for A > 0. Condition (V2) implies 
that there is a constant C2 > such that V{Xe) > A^y(e) — C2 for A large enough, 
and there holds 

^{\e)<\^ f llefdt-X" [ V{e{t))dt + C2<0. 
Jo 2 Jo 

Then wc take xq = Ae for large A such that the above inequalities holds. 
We define 

r = {/ieC([o,i],w)|/i(o) = o, h{i)^xo} 
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L 



and 



c= inf sup ^lJ{h{s)). 
f^^^ se[o,i] 



By using the Mountain pass theorem (cf. Theorem 2.2 of [25]), from the conditions 
(V2)-(V4) it is well known that there exists a critical point x E W ofip with critical 
value c > which is a Mountain pass point such that its Morse index satisfying 
m~{x,l) < 1. If we set y — X and z = {x,y) e R^"', the problem (3.7) can be 
transformed into the following problem 

z = -JH'{z), 
2;(0) e Lo, z{l) e Lo 

w\ih.H{z) = H{x,y) = l\y\^ + V{x). We note that (V5) implies H{Nz) = H{z), so 
(2, z) is a brake orbit with brake period 2. We remind that in this case the complex 
structure is — J, but it does not cause any diflBcult to apply the index theory. By 
Theorem 5.1 of [13], the Morse index m~ {x, 1) of x is just the Lo-index iLoi^j 1) of 
(1, z). i.e., there holds(see also Lemma 4.6 in the appendix below) 



m 



{x, 1) = 1), m°(x, 1) = i^Loiz, 1)- 



We can suppose the minimal period of x is 2/A; for /c G N. But ilo^z^ 1//c) = 
m~ {x,l/k) > 0, and from the convexity condition (V6), we have ii{z,2/k) > n. 
With the same arguments as in the proof of Theorem 3.1, we get k G {1, 2}. ■ 

We note that the functional ip is even, there may be infinite many solutions 
(r, x) satisfying Theorem 3.3. We also note that Theorem 3.3 is not a special case 
of Theorem 3.1, since the Hamiltonian function H{x, y) = ^\y\^ + V{x) is quadratic 

in the variables in this case S = ^ ^ with ||i?|| = 1. Thus when applying 

Theorem 3.1 to this case, we can only get the result of Theorem 3.3 for < r < 27r. 
We now consider the following problem 

x + V'{x)=0, xeW^, 

x{0) = x{t/2) = 0, (3.10) 
x{T/2 + t) = x{T/2-t), x{t + t) = x{t). 

A solution of (3.10) is also a kind of brake orbit for the second order Hamiltonian 
system. 

By set y = Xj z = (y, x) and H{z) = H{y, x) = + V{x), the problem (3.10) 
can be transformed into the following Lo-boundary value problem 

z = JH'{z) 

z{0) G Lo, z{t/2) g Lo. 

In this case the condition H{Nz) = H{z) is satisfied automatically. Set B = 
^ ' then = 1. The following result is a direct consequence of Theorem 




3.1. 
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Corollary 3.4. Suppose V satisfies the conditions (Vl)-(V^) and (V6). Then for 
every < r < 27r, the problem (3.10) possesses a non-constant solution {t,x) such 
that X has minimal period r or t/2. 

We note that if we directly solve the problem (3.10) by the same way as in the 
proof of Theorem 3.3, the formation of the functional is still ip as defined in (3.8), 
but the domain should be 

CO 

Wi^{xe W^'^{[0,l],R'')\x{t) = ^cos/cTTt-afc, Uk G M"}. 

k=0 

In this time, it is not able to apply the Mountain pass theorem to get a critical 
point directly due to the fact C Wi, so the inequality (3.9) is not true. 

§4 Appendix. Some properties for the indeices 

4.1. Some properties of Maslov-type index. For a symplectic path 7 G P(2n), 
its Maslov-type index is a pair of integers (21(7), z/i (7)) G Z x {0, 1, ■ ■ ■ , 2?i} (cf. 
[20], [21]). If 7 G V{2n) is the fundamental solution of a linear Hamiltonian system 

X = JB{t)x 

with continuous symmetric matrix function B{t), its Maslov-type index usually 
denoted by {ii{B), ui{B)). The following result was proved in [12]. 

Lemma 4.1. If Bi{t) — B2{t) > is a positive definite matrix function, then there 
holds 

ii(Si) >n(S2) + z/i(S2). (4.1) 

o.lso holds under the following condition 

B{t) ^ Bi{t) - B2{t) >0, I B{t)dt>0. 

Jo 

As a direct consequence, if the continuous symmetric matrix function satisfying 
B{t) > and B{t)dt > 0, then there holds 

ii{B)>n. (4.2) 

Definition 4.2. ([20],[21])Two symplectic paths 70 and 71 G V{2n) are homotopic 
on [0,1], denoted by 70 ~ 71, if there exists a map d G C([0, 1] x [0, 1], Sp(2n)) 
such that d{0, ■)= '^o{-), 5(1, ■) = 7i(-), d{s,-) — l2n, and ui{d{s,l)) is constant for 
< s < 1. 

We note that for two paths 70 and 71 G V{2n) with the same end points 70(1) = 
71(1), 70 ~ 71 with fixed end points if and only if «i(7o) = ■ii(7i)- By choosing 
suitable zigzag standard paths Un^k in V*{2n) with ii{an,k) — k and an^k{l) = 
if (— l)'^ = ±1 as in [22], and by the definition of the Maslov-type index, we have 
the following result. 
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Lemma 4.3. For a symplectic path 7 e V{2n) with 7(1) = M10M2, Mj G Sp(2nj), 
j = 1,2, ni + 77,2 = n, i/iere exists two symplectic paths 7^ e V{2nj) such that 
7 ~ 7i 072 and 7j(l) = Mj. 

The index function {iuj{'y),i^uj{l)) was defined for a; e U := {z e C| \z\ = 1} in 
[22] by Y.Long. 

Definition 4.4. ([22])For any M e Sp(2n) and u eV, choosing 7 e 7^(2n) with 
7(1) = M, the splitting numbers of M are defined by 

S^{u) = lim ^exp(±e^/^)a.(7) " 



The fo Rowing hst for the sphtting number comes from [21]. 

(1) (5+ (1), 5^(1)) = (1, 1) for M = Ari(l, 6) with 6 = 1 or 0. 

(2) (5+ (1), 5- (1)) = (0, 0) for M = iVi(l, -1). 

(3) (5+ (-1), 5m(-1)) = (1. 1) for M = iVi(-l, 6) with 6 = -1 or 0. 

(4) (^+ (-1), 5m(-1)) = (0, 0) for M = N,{-1, 1). 

(5) (5+ (e^^), 5^(e^^)) = (0, 1) for M = R{e) with 6 G (0, tt) U (tt, 27r). 

(6) {SI^{lo), Sm{u))) = (1, 1) for M = N2{u), h) being non-trivial with u = e 
U\M. 

(7) {S+{lj),Sm{u;)) = (0, 0) for M = N2{u;, h) being trivial with u = e U\R. 

(8) (5+ (cu), 5^(0;)) = (0, 0) for any a; e U and M e Sp(2n) satisfying a(M)nV = 0. 

4.2. Some properties of the Lo-index. For a symplectic path 7 e P(2n), the 
so called Lo-index (zlqIt); ^^Lo(7)) G ^ x {0, 1, • • • , n} was first defined in [13]. We 
have a brief introduction of this index theory in the section 2 of this paper. The 
following result was proved in [13]. 

Lemma 4.5. Suppose 7 e V{2n) is the fundamental solution of the following linear 
Hamiltonian system 

x{t) = JB{t)x{t), x{t) e M^", 
where B{t) — { ^^^^fl c^^S I symmetric with n x n blocks Sjk- If S22(t) > 

\ ^2l[t) 022[t) J 

(positive definite), there holds 

^Lo(7) = ^Lo(5)>0. (4.3) 

(4.3) is also true if S22{t) > and S22{t)dt > 0. 
We consider the following problem 



[P{t)x'{t) - Q{t)xit)y + Q^{t)x'{t) + R{t)x = 0, 
a;(0) =x{l) = 0, 



(4.4) 



where P and R are symmetrial nxn matrix function, we suppose —P > (positive 
definite). For simplicity. We assume P,Q are smooth and R is continuous. The 
equations in (4.4) was studied by M.Morse. We turn it into a first order equations 
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with Lagrangian boundary condition by setting z{t) = {x{t),y{t))'^ e R^" with 
y = P{t)x'{t)-Q{t)x{ty. 

z{0), z{l) e Lo, 



where B — B{t) is defined by 
B{t)^ 



-R{t) - Q'^{t)P-\t)Q{t) -Q^{t)P-\t) 
-P-\t)Q{t) -P-\t) 

We take the space W = W(}'^([0, the subspace of ^^^'^([0, 1],R") with the 

elements x satisfying x(0) = x{l) = 0. Define the following functional on W 

^(x) = -\ j\p-\t)iPit)x\t) - Q{t)x{t)), P{t)x'{t) - Q{t)x{t)) 

- {{R{t) + Q'^{t)p-\t)Q{t))x{t), xit)) dt. 

The critical point of <^ is a solution of the problem (4.4), and so we get a solution of 
the problem (4.5). Denote the Morse index of the functional <^ at a; = by (B), 
which is the total multiplicity of the negative eigenvalues of the Hessian of (p at 
X = 0, and the nullity by n^°{B). The following result was proved in [13]. 

Lemma 4.6. There holds 

iL,{B)=m'^°{B), VL,{B)=n'^-{B). 



Let i? be a separable Hilbert space, and Q = A — B : E ^ E he a, bounded 
salf-adjoint linear operators with B : E ^ E a, compact self-adjoint operator. 
N = kerQ and dim AT < +00. Q|jv-l is invertible. P : E ^ N the orthogonal 
projection. Set d = i||(Q|jvx)~^||~^ T = {Pk\k = 1,2, •••} be the Galerkin 
approximation sequence of A: 

(1) Ek '■— PkE is finite dimensional for all /c e N, 

(2) Pk ^ I strongly as /c — >• +00 

(3) PkA = APk. 

For an operator S, we denote by M*{S) the eigenspaces of S with eigenvalues 
belonging to (0, +00), {0} and (—00, 0) with * = +, and * = — , respectively. We 
denote by m*{S) = dimM*(S'). Similarly, we denote by M^{S) the (i-eigenspaces 
of S with eigenvalues belonging to ((i, +00), (—d^d) and {—00,—d) with * = +, 
and * = — , respectively. We denote by m*^{S) = dimM^(S'). 

Lemma 4.7. (Lemma 3.3 in [16]) Let B he a linear symmetric compact operator. 
Then the difference of the d-Morse indices 

m- {P^{A - B)Pm) - m- {P^AP^) (4.6) 

eventually becomes a constant independent of m, where d > is determined by the 
operators A and A — B. Moreover mP^{Pm{A — B)Pm) eventually becomes a constant 
independent of m and for large m, there holds 

m°(P^(A - B)Pm) = m%A - B). (4.7) 
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Definition 4.8. ([16]) For the operators A and B in Lemma J^..!, F is an Galerkin 
approximation sequence w.r.t A, we define the relative index by 

I{A, A-B) = m^{Pm{A - B)Pm) - m^iPmAPm), m > m*, (4.8) 

where m* > is a constant large enough such that the difference in (4-6) becomes 
a constant independent of m > m* . 

For ijo = e^'^^, we define a Hilbert space E'^ = Ef^ consisting of those x{t) in 
L2([0, 1], C^*^) such that e-'^^^x{t) has Fourier series 

and 

\\xf := ^(1 + \k\)\akf < oo. 

For x G E'^, we can write 



3 

So we can write 



x{t) = m+ mi-t), m = E e^'^^-^^^' ( ^^^^/^ ) . (4.9) 



For u = 1, i.e., 6* = 0, we define two selfadjoint operators Ai,Bi e C{E^) by- 
extending the bilinear forms 

{Aix,y)^ [ {-Jx{t),yit))dt, {B^x.y) = [ {B{t)x,y)dt 







on E^, here (•, •) is the Hermitian inner product in C^"^. Then B is compact. For 
CO = e^'^, 9 e [0,7r), we define two self-adjoint operators A'^.B'^ e C{E'^) by 
extending the bilinear forms 



{A^x.y) = / {-Jx{f),y{t))dt, 
Jo 

{B^x,y)= [ ( 

^0 



{B{t)x{t),y{t))dt 

on where we have written x{t) = ^{t) + N^{—t), y{t) = r]{t) + Nr]{—t) as in 
(3.10). Then B'^ is also compact. 

By Theorem 2.1 of [14], we have the following formula 

I{A^,A^-B^) = iL^{B) + n. (4.10) 
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Definition 4.9. ([16]) We define the index function 



il^°{B) :=I{A'',A^ -B""), u^°{B) := m\A^ - B"^), a; = 9e (0,7r). 

Lemma 4.10. ([16]) The index function i[^"(B) is locally constant. For uq = 
e^^~^^", 6*0 G (0, tt) is a point of discontinuity ofi[^°{B), then u^°{B) > and so 
dim(7(l)Lo fl e^""^Lo) > 0. Moreover there hold 

K^o°- (^) - 'to (B) I < ^^0" (^) ' K^o (S) + n - i^l (B) I < z.,., (B) , 

where i[^°_^_{B), i[^°_{B) are the right and left limit respectively of the index function 
i^°{B) at coq = e^^^^° as a function of 9. 

By (4.10), Definition 4.9 and Lemma 4.10, we see that for any uq = 6^^^^°, ^0 € 
(0, tt), there holds 

it°{B)>iL,{B)+n- Yl ^-°(^)- (4.12) 

0<6><6lo 

We note that 

o<e<eo 

So we have 

iLo{B)<i[^°{B)<iLo{B) + n. 
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